Tension Bounds for Information Complexity
نویسندگان
چکیده
The main contribution of this work is to relate information complexity to “tension” [PP14] – an informationtheoretic quantity defined with no reference to protocols – and to illustrate that it allows deriving strong lower-bounds on information complexity. In particular, we use a very special case of this connection to give a quantitatively tighter connection between information complexity and discrepancy than the one in [BW12] (albeit, restricted to independent inputs). Further, as tension is in fact a multi-dimensional notion, it enables us to bound the 2-dimensional region that represents the trade-off between the amounts of communication in the two directions, in a 2-party protocol. This work is also intended to highlight tension as a fundamental measure of correlation between a pair of random variables, with rich connections to a variety of questions in computer science and information theory. ∗Department of Computer Science, University of Illinois, Urbana-Champaign. [email protected]. †School of Technology and Computer Science, Tata Institute of Fundamental Research, Mumbai, India. [email protected] ar X iv :1 40 8. 62 85 v1 [ cs .C C ] 2 7 A ug 2 01 4
منابع مشابه
Towards a Theory of Multiparty Information Complexity
Communication complexity seeks to characterize the complexity of computation by measuring the amount of communication that must be used by players computing the output of some function f , each of whom have only partial information about the inputs to f . The past thirty years have seen the development of a number of lower-bound techniques in communication complexity, which fall roughly into tw...
متن کاملCS 2429 - Foundations of Communication Complexity Lecture # 7 : 31 October 2012 Lecturer : Lila Fontes
Another important technique for proving lower bounds in communication complexity comes from information theory. In Information Complexity and the Direct Sum Problem for Simultaneous Message Complexity (FOCS 2001), Chakrabarti, Shi, Wirth, and Yao introduced the notion of information complexity and used it to prove new lower bounds on the direct sum of the equality function. Follow-up work by Ba...
متن کاملInformation complexity of neural networks
This paper studies the question of lower bounds on the number of neurons and examples necessary to program a given task into feed forward neural networks. We introduce the notion of information complexity of a network to complement that of neural complexity. Neural complexity deals with lower bounds for neural resources (numbers of neurons) needed by a network to perform a given task within a g...
متن کاملSystem reliability approach to rock slope stability
A systematic quantitative methodology for the reliability analysis of stability of rock slopes is presented. A sliding mass resting on an inclined plane and composed of two blocks separated by a vertical tension crack is considered, and a disjoint cut-set system formulation is proposed, with each cut-set corresponding to a different failure mode of the slope. Methods for the evaluation of the s...
متن کاملTrellis decoding complexity of linear block codes
AbstructIn this partially tutorial paper, we examine minimal trellis representations of linear block codes and analyze several measures of trellis complexity: maximum state and edge dimensions, total span length, and total vertices, edges and mergers. We obtain bounds on these complexities as extensions of well-known dimensiodlength profile (DLP) bounds. Codes meeting these bounds minimize all ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1408.6285 شماره
صفحات -
تاریخ انتشار 2014